Detection of feeling through back-channels in spoken dialogue
نویسندگان
چکیده
We investigate the usage of back-channel information in the information navigation dialogue between an expert guide and a user. By back-channel feedback, we mean the user’s verbal short response, which expresses his state of the mind during the dialogue. Its prototypical lexical entries include “hai” in Japanese and “yes” or “right” in English, however, we do not count explicit affirmative responses as back-channels. Previously, there were several works[1, 2] which attempted to automatically generate back-channel responses for smooth communication between the user and the system. Recently, the back-channel information is included in the framework of dialogue act tagging in the game-playing dialogue[3] and meetings[4]. In the information navigation dialogue, in which an expert guide presents a list of recommendation spots, it is expected that the prosodic pattern of the back-channel conveys the para-linguistic information, that is, it suggests the positive/negative feeling on the recommended candidate. We also presume that the human expert guide detects such feelings expressed via back-channels, and chooses to continue the explanation of the current topic if the user seems interested, or change the topic otherwise. Thus, we investigate the back-channel patterns observed in the Kyoto Tour Guide Dialog Corpus.
منابع مشابه
On-Line Learning of a Persian Spoken Dialogue System Using Real Training Data
The first spoken dialogue system developed for the Persian language is introduced. This is a ticket reservation system with Persian ASR and NLU modules. The focus of the paper is on learning the dialogue management module. In this work, real on-line training data are used during the learning process. For on-line learning, the effect of the variations of discount factor (g) on the learning speed...
متن کاملOn-Line Learning of a Persian Spoken Dialogue System Using Real Training Data
The first spoken dialogue system developed for the Persian language is introduced. This is a ticket reservation system with Persian ASR and NLU modules. The focus of the paper is on learning the dialogue management module. In this work, real on-line training data are used during the learning process. For on-line learning, the effect of the variations of discount factor (g) on the learning speed...
متن کاملConstruction of Back-Channel Utterance Corpus for Responsive Spoken Dialogue System Development
In spoken dialogues, if a spoken dialogue system does not respond at all during user’s utterances, the user might feel uneasy because the user does not know whether or not the system has recognized the utterances. In particular, back-channel utterances, which the system outputs as voices such as“yeah”and“uh huh”in English have important roles for a driver in in-car speech dialogues because the ...
متن کاملCoherent Back-Channel Feedback Tagging of In-Car Spoken Dialogue Corpus
This paper describes the design of a backchannel feedback corpus and its evaluation, aiming at realizing in-car spoken dialogue systems with high responsiveness. We constructed our corpus by annotating the existing in-car spoken dialogue data with back-channel feedback timing information in an off-line environment. Our corpus can be practically used in developing dialogue systems which can prov...
متن کاملDialogue Speech Recognition by Combining Hierarchical Topic Classification and Language Model Switching
An efficient, scalable speech recognition architecture combining topic detection and topic-dependent language modeling is proposed for multi-domain spoken language systems. In the proposed approach, the inferred topic is automatically detected from the user’s utterance, and speech recognition is then performed by applying an appropriate topic-dependent language model. This approach enables user...
متن کامل